Search AI Products and News

A study found that nearly half of popular news websites block OpenAI crawlers. Traditional print media websites are more likely to block OpenAI crawlers. New AI models may experience degradation when trained using previous models. AI crawlers are used to collect data for training language models. News organizations in Northern Hemisphere countries are more inclined to block AI crawlers.

A study by Reuters found that 48% of popular news websites block OpenAI crawlers. The issue of using copyrighted materials by artificial intelligence divides media into traditional print publications, television and radio broadcasters, and digital media. Some websites block Google and OpenAI crawlers, with northern hemisphere news media more likely to stop AI crawlers.